Bridging the ARCH model for finance and nonextensive entropy 
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Engle's ARCH algorithm is a generator of stochastic time series for financial returns (and similar 
quantities) characterized by a time-dependent variance. It involves a memory parameter & (& = 
corresponds to no memory), and the noise is currently chosen to be Gaussian. We assume here 
a generalized noise, namely Qn-Gaussian, characterized by an index q„ G TZ {qn = 1 recovers the 
Gaussian case, and > 1 corresponds to tailed distributions). We then match the second and 
fourth momenta of the ARCH return distribution with those associated with the g-Gaussian distri- 
bution obtained through optimization of the entropy Sq — , basis of nonextensive statistical 
mechanics. The outcome is an analytic distribution for the returns, where an unique q > qn corre- 
sponds to each pair {b,qn) {q = qn if 6 = 0). This distribution is compared with numerical results 
and appears to be remarkably precise. This system constitutes a simple, low-dimensional, dynamical 
mechanism which accommodates well within the current nonextensive framework. 
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Time series are ubiquitous in nature. They appear in 
geoseismic phenomena. El Nino, finance, electrocardio- 
and electroencephalographic profiles, among many oth- 
ers. Some of these series can be constructed by using, for 
successive values ot time t, random variables associated 
with the same distribution for all times: they are called 
homoskedastic. Such is the case of the ordinary Brownian 
motion. But many phenomena exist in nature which do 
not accomodate with such a property, i.e., the distribu- 
tion associated with each value of t depends on t. Such 
random variables are then called heteroskedastic. A sim- 
ple illustration would be to use say a centered Gaussian 
at all steps, but with a randomly varying width. 

Nowadays, time series that are intensively studied are 
the financial ones, where nonstationary volatility (tech- 
nical name for second-order moment of say returns) is a 
common feature [1-3]. In order to mimic explicitly and 
analyze this type of time series, R.F. Engle introduced 
in 1982 the autoregressive conditional heteroskedasticity 
(ARCH) process [4] . Its prominence can be measured by 
its wide use, by the amount of its extensions introduced 
later [5,6], and — last but not least — by the fact that 
the 2003 Nobel Prize for Economics was awarded to En- 
gle "for methods of analyzing economic time series with 
time- varying volatility (ARCH)". This and similar pro- 
cesses are commonly used in the implementation of asset 
pricing theories, market microstructure models, and pric- 
ing derivative assets [6,7] (see also [8]). Specifically, the 
ARCH(s) [4] process generates, for the returns Zt, a dis- 
crete time series whose variance erf, at each time step, 
depends linearly on the s previous values of [ztY . It is 
defined as follows: 



r zt = (Ttu}t, 

or, equivalently. 



zt = ^a + h ujt 

where a, bi, Ui > 0, and ut represents an independent and 
identically distributed stochastic process with mean value 
null and unit variance, (i.e., {ujt) — and (wf) — 1), cur- 
rently chosen to follow a Gaussian distribution, but other 
choices are possible. In this manuscript we will discuss 
in detail the usual case s = 1, ARCH(l), which will be 
from now on simply designated by ARCH. In general, 
the distribution, P„ (uj), together with parameters a and 
{bi}, specify the particular ARCH process {n stands for 
noise). 

As can be seen from Eqs. (2), parameters {bi} charac- 
terize the memory mechanism. For bi = (V?), there is 
no memory effect, and consequently the ARCH process 
for returns reduces to generating the noise ujt (multiplied 
by v^)- We can verify that, in general, (zt) — {at){wt) — 
0, and (ztZf) = {atcrt'){ujtt^t') = {(^tf^v) Sw ■ Therefore, 
even for nonvanishing biS, the returns Zt remain uncor- 
related, whereas correlations do exist in the variance ctj 
[5] . We observe that this stochastic process captures the 
tendency for the so called volatility clustering, i.e., large 
(small) values of zt are followed by other large (small) 
values of zt+i, but of arbitrary sign. In other words, 
{\zt \ \zt'\) by no means is proportional to Su' ■ 
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Hereon we focus on ARCH(l), i.e., bi = b and hi = 
(z = 2, 3,...). From Eqs. (1) it is simple to obtain 
the n-th moment for the P{z) stationary distributions, 
particularly the second moment 

a'^{z^) = {a^) = ^^ (6<1), (3) 
and the fourth moment, 



1 + 6 



(1-6) (1-62 (^4^) 



(4) 



Without loss of generality, we can assume that the 
ARCH procedure generates a time series with unit vari- 
ance, i.e., = 1, hence a= 1 — 6. Now, for Zt, the fourth 

moment is numerically equal to the kurtosis kx = , 2/5 

\x } 

(a possible measure of non-gaussianity or peakedness for 
probability distributions), and we can easily get, 

kf. 



tyZ^ ) — kz — 



1 + 6^ 



1 



1 - kjy' 



{k^b' < 1) , (5) 



It is straightforwardly verified that, whatever the form of 
Pn {to) , the ARCH process generates probability distribu- 
tions P (z) with a slower decay and consequently with a 
kurtosis kz > [9-12]. See in Figs. 1 and 2, typical 
runs for a Gaussian noise. 




FIG. 1. Two examples of ARCH time series obtained for a 
Gaussian noise (i.e., g„ = 1). Memory (i.e., 6 > 0) increases 

the probability for large values of \zt\, i.e., fat tails in P{z). 
The large value at t = 237 is virtually never observed for 
6 = 0. 




150 t 



300 



FIG. 2. Time dependence of the volatility a for the same 
two ARCH processes shown in Fig. 1. The largest value for 
a occurs at t = 238. 

We shall now establish a possible analytical connection 
between the memory parameter 6, P (z) and P„ (a;) under 
the framework of the nonextensive statistical mechanics 
introduced by one of us [13] . Consider a probability dis- 
tribution P' (z) such that it maximizes the entropic form 



i-i^::[p'{z)rdz 

q-l 



(6) 



with limg^iS', = - j;^^ P'{z)\nP'{z)dz = Sbg {BG 
stands for Boltzmann-Gibhs). Maximizing Eq. (6) with 
the constraints J 
1 we have 



-t-CX) 

00 



P'{z)dz = 1 and z^P'{z)dz = 



P'{z) 



A 



[l + B{q-l)z^]' 



{q < 5/3) , 



(7) 



with 



B 
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'5-3(/' 
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2q-2 



(8) 



and 
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1 
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3-q 
2q-2 



^{2q-l)B. 



(9) 



In the g ^ 1 limit, the normal distribution is recovered. 
The fourth moment (which for this case coincides with 
the kurtosis) is given by, 



r [ 7-59 ] p r 3-g ] 
\_2q-2\ [2q-2j 



(i<g< 



(10) 



Let us now make the ansatz P' [z) ~ P {z). Consistently 

wc impose the matching of Eqs. (5) and (10) . This 
yields g as a function of 6 and k^. Assuming that noise 
LOt follows a generalized distribution, Eq. (7), defined by 
an entropic index (such that /ji?"^;^ < 1) we arc able 
to establish a relation between the memory parameter 
6 and the entropic indexes q and which character- 
ize respectively the; distributions P' (z) and P„ {w). This 
connection is straightforwardly given by 



yG(g){r [|-^]}'-G(,„){r[|^]} 



^G{qn) (3G(9)-{r[i^]} 



(11) 
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where G{x) 



7-5x 


T 


3—x 


2x-2 




2x-2 



This connection, de- 



picted in Fig. 3, constitutes, to the best of our knowledge, 
the first ever found which analytically expresses the re- 
turn distribution in terms of the noise distribution and 
the memory parameter b. In what follows we shall verify 
that the above ansatz is indeed satisfied within a remark- 
able precision. To do this for typical values of b and (/„, 
we first generate, through a standard algorithm based 
on Eq.(l) (with s = 1), a set of ARCH time series and 
their corresponding probability density functions (PDF's) 
P{z). The results are indicated in Figs. 4 and 5. Then 
we compare with a histogram (with a conveniently cho- 
sen unit interval S) associated with the distribution (7), 

with q satisfying Eq. (11). In other words, we compare 

1 

with As [l — B{1 — q) x^] ^"^ , where B is given by Eq. 
(8), and 



^6 = 1 



Lj 



1 _J_. 3 

2 ' q-1 ' 2 ' 



5-3q ] 
2q-2\ 



sr 



(12) 
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FIG. 3. Diagram {q,qn,b) for the ARCH process with 
(z^) = 1 (for 6 = we have the straight line q = qn). 

We verify that the agreement is quite satisfactory. 
In order to quantify the small discrepancy between the 
ARCH PDF's P{z) and the analytical ones P'(z), we 
have indicated in the captions of Figs. 4 and 5 the val- 

N 

ues of = ^ [Pi/^i) ~ P'{^i)Y^ ^ being the number 



of points. An alternative evaluation of the discrepancy 
of the ARCH and analytical distribution can be done by 



comparing the sixth-order moment. It is simple to ver- 
ify that these momenta for P{z) and P'{z) exhibit quite 
small discrepancies. For example, for the cases illustrated 
in Figs. 4 and 5, we have obtained discrepancies never 
larger than 2.9% (occuring in fact for b ~ 0.5) for qn = ^ 
and than 2.7% (occuring in fact for b ~ 0.3) for g„ = 1.3. 
Such minor discrepancies arc. in financial practice, com- 
pletely inocuous (for example, we may check in [14,15] 
that realistic return distributions are larger than 10~^, 
whereas in our present Figs. 4 and 5 we have simulated 
down to 10"®). 
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4. PDFs for a = 1 noise and typical values of 



0, q = 1 ix' 



q = 1.01976 (x^ = 2.34 x 10"") 
(X^ = 1.82 X 10"^°); d) b = 0.5, q 



1.14 X 10""); b) 6 = 0.1, 
c) & = 0.4, q = 1.242424 
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(X^ =2.98 X 10"^°). 
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FIG. 5. PDFs for a qn = 1-3 noise and typical val- 
ues of 6. a) b = 0, q = 1.3 (x^ = 3.93 x 10"^°); b) 
b = 0.1, q = 1.30762 (x^ = 8.86 x 10"^°); c) & = 0.2, 
q = 1.32950 (x^ = 9-72 x 10"^"^); d) b = 0.3, q = 1.36306 
(X^ = 2.68 X 10"i°). 

Let us conclude by saying that the fact that a close 
connection has been shown to exist between the possibly 
ubiquitous ARCH stochastic processes and the nonex- 
tensive entropy Eq.(6) strongly suggests further possible 
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connections. We refer to phenomena which might present 
some kind of scale invariant geometry, e.g., hierarchi- 
cal or multifractal structures, low-dimensional dissipative 
and conservative maps [16], fractional and/or nonlinear 
Fokker- Planck equations [17], Langevin dynamics with 
fluctuating temperature [18], possibly scale- free network 
growth [19], long-range many-body classical Hamiltoni- 
ans [20-22], among others. A more detailed study of this 
as well as of other heteroskedastic models (e.g., GARCH) 
is in progress. 
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